Tasks

Command Line Interface (CLI) Implementation

• Implement CLI parsing for single command input.
• Handle mandatory and optional arguments
• CLI prints

Accuracy Score Calculation

• Compare expected Q&A pages with Finesse response pages.
• Calculate accuracy score for each response based on document's position in the results.
• Implement scoring ranging from 0 to 1.0.

Round trip time

• Calculate the round trip time

Statistical summary

• Calculate a statistical summary of both Accuracy score and round trip time

Output

• CSV saving function
• md saving function

Documentation

• Write clear and concise documentation for the tool.
• Provide usage examples and explanations for each command-line argument.

Acceptance criteria

• Facilitate Comparative Evaluation of Search Engines
• Provide Accurate and Actionable Results
• Facilitate Search Engine Development and Optimization